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(54) innage information applying method and apparatus and recording medium 



(57) This invention provides a picture information 
applying method and apparatus for causing a recording 
medium to be used for another application and a record- 
ing medium used therefor. For this purpose, picture data 
(102) is recorded on a recording medium (100) and 
associated information (P11) containing at least a to-be- 
connected destination and merchandise guidance for a 
merchandise appearing in a video image (P1) displayed 




based on the picture data is recorded, and when a 
recording signal of the recording medium is played 
back, the corresponding merchandise guidance can be 
observed based on the associated information and it is 
made possible to make contact with the destination 
associated with the corresponding merchandise based 
on the associated information. 
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Description 

[0001] This invention relates to a picture information 
applying method and apparatus capable of effectively 
applying picture information recorded on a recording 5 
medium such as an optical disk or magnetic disk, and a 
recording medium used therefor. 
[0002] There is provided a system for causing video 
information to be recorded on an optical disk and per- 
mitting the user to enjoy Karaoke songs. Further, there 
is provided a CD-ROM as an information providing 
medium. However, most of the conventional recording 
media of this type are used to supply pictures, voices or 
information in one direction from the recording media to 
the users. Therefore, it is difficult for the manufacturer of 
the recording media to obtain the reactions of the users 
form various fields after the recording media were sokj. 
[0003] According to the system of the conventional 
recording media, it is difficult for the manufacturer of the 
recording media to obtain the reactions of the users 
after the recording media were sold and it is required to 
separately conduct the questionnaire in order to obtain 
information used for making next software. 
[0004] An object of this invention is to provide a picture 
information applying method and apparatus capat^e of 
causing a recording medium to be used in another 
application, and a recording medium used theretor. 
[0005] In order to attain the above object, this inven- 
tion is made to record picture data on a recording 
medium and record associated information containing 
at least a to-be-connected destination and merchandise 
guidance for a merchandise appearing in a video image 
displayed based on the picture data so as to make it 
possible to observe the corresponding merchandise 
guidance based on the associated information and 
n^ke contact with the destination associated with the 
corresponding merchandise based on the associated 
information when a recording signal of the recording 
medium is played back. 

[0006] It becomes possible to effectively use the pic- 
ture information recorded on the recording medium by 
use of the above means and the manufacturer of the 
recording media can collect reaction information of the 
users based on the picture information. 
[0007] Further, the manufacturer of the recording 
media can collect funds by using merchandise suppliers 
(clothes, devices and the like) as sponsors when the 
manufacturer makes a film or the like. 
[0008] This summary of the invention does not neces- 
sarily desaibe all necessary features so that the inven- 
tion may also be a sub-combination of these described 
features. 

[0009] The invention can be more fully understood 
from the following detailed desaiption when taken in 
conjunction with the accompanying drawings, in which: 

FIGS. 1 A, 1B are views showing the outer appear- 
ance of a disk playback apparatus to which this 



Invention Is applied and a display; 
FIG. 2 is a diagram showing field pictures or frame 
pictures shown in a simplified form for illustrating 
the function in one embodiment of this invention; 
FIG. 3 is a view showing an example of a state in 
which the apparatus of this invention is used; 
FIGS. 4A, 4B are views showing examples of the 
window when the apparatus of this invention is 
used; 

FIG. 5 is a diagram showing an example of a data 
recording area of a disk to which this invention is 
applied; 

FIG. 6 is a flowchart for illustrating an example of 
the operation of a system according to this inven- 
tion; 

FIG. 7 is a flowchart for illustrating an example of 
tiie operation of a systenh according to this inven- 
tion; 

FIG. 8 is a view showing the outer appearance of 
an apparatus according to this invention; 
FIG. 9 is a flowchart for illustrating an example of 
. tiie operation of the apparatus shown in FIG. 8; 
FIG. 10 is a flowchart for illustrating an example of 
the operation of the apparatus shown in FIG. 8; 
FIG. 11 is a flowchart for illusti'ating another exam- 
ple of the operation of the apparatus shown in FIG. 
8; 

FIG. 12 is a diagram showing an additional function 
of an apparatus according to tiiis invention; 
FIGS. 13A, 13B are views showing examples of a 
display window for illustrating examples of the oper- 
ation of tiie apparatus of FIG. 12; 
FIG. 14 is a view for illustrating the operation of a 
business logic applying section of FIG. 12; and 
FIG. 15 is a view showing an example of the win- 
dow for illustrating an example of the operation of 
the apparatus of FIG. 12. 

[001 0] There will now be described an embodiment of 
this invention with reference to the accompanying draw- 
ings. 

[0011] FIGS. 1 A, IB are views showing the outer 
appearance of a disk playback apparatus to which this 
invention is applied. In FIG. 1A. a reference numeral 
1 00 denotes an optical disk. As the optical disk, a digital 
video disk (DVD) which is recently developed, a read- 
only compact disk (CD-ROM) or tiie like is used. Oh the 
optical disk, picture data of moving pictures of a film or 
tiie like is recorded in a compressed form and associ- 
ated information containing at least a to-be-connected 
destination and merchandise guidance for a merchan- 
dise appearing in a video image as will be described 
later is recorded. 

[0012] A reference numeral 200 denotes a disk play- 
back apparatus and a video signal obtained by the disk 
playback apparatus 200 is supplied to and displayed on 
a display 300 such as a television receiver. An operation 
input can be entered by use of a remote control system. 
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[001 3] FIG. 1 B shows the outer appearance of a per- 
sonal computer 400 used for playing back the optical 
disk 100. 

[0014] FIG. 2 shews a state in which video data 
recorded on the optical disk 100 is decoded and pic- 
tures are displayed in the unit of field (or in the unit of 
frame). In FIG. 2, fields are arranged on the time base. 
In the playback picture of the optical disk, additional 
information accessing pictures P11. PI 2 are inserted 
into parts of the pictures of the fields which lie in the 
intermediate positions thereof. The pictures in which the 
additional information accessing pictures P11, PI 2 are 
inserted are respectively referred to as specified pic- 
tures PI , P2. 

[001 5] The additional information accessing pictures 
P1 1 . P12 are each inserted into a field which is so short 
period that it does not remain in the eyes of the viewer 
when the film is normally continuously played back. 
Therefore, in FIG. 2, the additional information access- 
ing picture P1 1 is inserted into one specified picture P1 . 
but the additional information accessing picture P1 1 of 
the same contents can be inserted into frame pictures 
before and after the specified picture. 
[0016] FIG. 3 shows an example in which the speci- 
fied picture PI is played back in a still form, for example. 
Since the additional intormation accessing picture P1 1 
is inserted into the specified picture PI. the viewer can 
ot^erve the additional information accessing picture 
P11. The additional information accessing picture P11 
is part of the associated information containing at least 
a to-be-connected destination and merchandise guid- 
ance for a merchandise appearing in the video image. 
[0017] In the additional information accessing picture 
P11, for example, a search nunnber for permitting the 
viewer to access a specified position of the optical disk 
100 is displayed. 

[001 8] In this case, if the viewer is interested in a mer- 
chandise (in the example shown in FIG. 3, a table, chair, 
shirt which the performer wears, parasol or the like) now 
appearing in the video image, he specifies the search 
nunnber by use of the remote control system or ten-key 
pad. Then, the playback apparatus or personal compu- 
ter reads out and displays address data corresponding 
to the search number on the optical disk 1 00. 
[0019] FIGS. 4A, 4B show examples of the window 
read out and displayed according to the search number 
and the display contents thereof (additional information 
items P41. P42). On the window of the additional infor- 
mation P41. the table and parasol which appeared in 
the previous video image contents are displayed and 
various items such as the maker's name, merchandise 
code, price, validity period. "YES" or "NO" of the order, 
the quantity of merchandises ordered, the telephone 
number of the destination, the store's name and the like 
are displayed as video images beside the correspond- 
ing merchandise. If the viewer clicks the item. of a next 
page by use of a cursor or by the keyboard operation, a 
window of the additional information P42 appears, the 



shirt and shoes which appeared in the previous video 
image contents are displayed and various items such as 
the maker's name, merchandise code, price, validity 
period, "YES" or "NO" of the order, the quantity of mer- 

5 chandises ordered, the telephone number of the desti- 
nation, the store's name and the like are displayed as 
video images beside the corresponding merchandise. 
[0020] At this time, when a merchandise which the 
viewer wants to obtain is present, an order can be auto- 

10 matically given to the selling agency if the viewer clicks 
"YES" of the item of the order by use of a cursor or by 
the keyboard operation. 

[0021 ] As described above, in the system, picture data 
is recorded on the recording medium and associated 

15 information containing at least a to-be-connected desti- 
nation and merchandise guidance for a merchandise 
appearing in a video image displayed based on the pic- 
ture data is recorded, and the viewer is permitted to 
observe the corresponding merchandise guidance 

20 based on the associated information and make contact 
with the destination associated with the corresponding 
merchandise based on the associated information when 
a recording signal of the recording medium is played 
back. 

25 [0022] As a result, the viewer can not only see the film 
recorded on the optical disk but also variously use a 
thing which a person appearing on the film uses or a 
wear which a person appearing on the film wears as 
merchandise information. 

30 [0023] In FIG. 5, a data recording area of the optical 
disk 100 is shown in a brief form. In the optical disk 100. 
a management information area 101 and a data area 
1 02 in which compressed picture data such as a film is 
recorded are provided. Further, in the optical disk 100. 

35 as explained with reference to FIG. 2, an additional 
information accessing picture (first associated informa- 
tion) attached to the picture in the data area and addi- 
tional information (second associated information) 
shown in FIG. 4 are provided in an additional informa- 

40 tion area 103. 

[0024] As management information of the manage- 
ment information area 101. attribute information items 
such as the title of picture contents of video data, 
recording position, compression method and the like 

45 are described. Particularly, a specified picture address 
used for searching for a specified picture is also 
recorded as a table in the management information. 
[0025] FIG. 6 is an operation flowchart in the playback 
apparatus when the viewer searches for specified pic- 

50 tures PI. P2 after tiie viewer played back the optical 
disk 100 and saw the film. That is. the operation 
explained below is an operation of associated informa- 
tion processing means. The associated information 
processing means is constructed by software of an 

55 overall management section (system control section) or 
microprocessor in the disk playback apparatus or per- 
sonal computer. The software may be previously 
recorded on the optical disk and transferred so as to 
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construct part o1 the overall management section in the 
personal computer. 

[0026] if a specified picture search mode is set, the 
playback apparatus moves the pickup to read out a 
specified picture address previously described in man- 
agement information (FIG. 5) and further moves the 
pickup based on the readout address to read out picture 
data of the specified picture PI. Then, the picture data 
is decoded and the still playback mode is set (step>s A1 . 
A2). In this state, the standby state is set until the viewer 
issues an instruction for additional information access 
or an instruction for next specified picture search (step 
A3). If the instruction for next specified picture search is 
issued, the step A1 is effected again to search for a next 
specified picture P2. Further, rf the instruction for addi- 
tional information access is issued, additional informa- 
tion of an address corresponding to a search nunober 
specified at this time is read out and displayed as shown 
in FIG. 4 (step A4). The instruction for additional infor- 
mation access is issued by operating the remote control 
unit by the user, for example. 

[0027] Next, whether the order for merchandise is 
input or not is determined (step A6) and if the order is 
placed, an order data process is effected (step AT). The 
contents of the order data process are explained in 
detail later. If the order for merchandise is not placed, 
that is, if "NO" in the item of FIG. 4 is clicked, whether a 
cancel input is made or not is determined (step A8). If 
no cancellation is made, whether an instruction for dis- 
playing additional information of the next page is issued 
or not is determined (step A5). If a cancel input is made, 
whether the instruction for searching for a next specified 
picture is issued or not is determined (step A9), and if 
the searching instruction is issued, the step A1 is 
effected again, and if the searching instruction is not 
issued, the process is terminated (step A10). The order 
input, cancel input, searching instruction or the like can 
be issued by operating the remote control unit by the 
user, for example. 

[0028] FIG. 7 is a ftowchart showing the contents of 
the data processing step A7 of FIG. 6 more in detail. 
[0029] In this system, the user can select the opera- 
tion for ordering a selected merchandise to the selling 
agency or the operation for simply collecting information 
associated with the merchandise. Therefore, if the 
"order (YES)" is pointed in the step A6 of FIG, 6, the 
selection item of "ordering" or "information collection" 
appears on the window. The selection item is displayed 
in a flushing manner. At this time, if the user selects the 
item of information collection, a data storage process 
associated with a selected merchandise is effected after 
effecting the steps B1, B2 (step B3). The stored data 
can be used when the merchandise is analyzed later. 
The analysis of the merchandise includes a process for 
comparing the prices, for example. 
[0030] If an ordering mode is specified, the ordered 
merchandise is displayed more in detail and the mer- 
chandise can be confirmed (step B5). Next, the validity 



period is confined (step B6) and if the validity period has 
already elapsed, the warning display is made and the 
step A4 is effected again. If it is within the validity period, 
the total amount corresponding to the specified quantity 

5 of merchandises and the unit price of the merchandise 
is displayed and a window for inquiry about the payment 
method is displayed (step B7). Determination of the 
validity period is made by comparing validity period 
information with timer information which the apparatus 

10 has. 

[0031 ] The payment method is a method of lanrrp-sum 
payment, monthly payment, payment by credit card, or 
payment by cash transfer. Further, at this time, it is pos- 
sible to input correction for the quantity of merchandises 

15 and the like. 

[0032] If the'monthly payment is specified, the pay- 
ment plan table is displayed and the payment amount 
for each month and the payment date are displayed 
(step 88). In this case, the user can cancel the order by 

20 taking his payment ability into consideration (step B9). 
[0033] If the order of the merchandise is not cancelled, 
the circuit is connected (step B10} and data is trans- 
ferred (step B1 1). The circuit connection is made via the 
public communication line by automatically using a tele- 

25 phone number of the selling store associated with the 
ordered merchandise. That is, the apparatus has a 
function of transferring data associated with the ordered 
merchandise via a transmission line based on the desti- 
nation information. 

30 [0034] In the selling store, data (merchandise code, 
identrftcation code of the orderer and the like) is 
received, the orderer and the ordered merchandise are 
confirmed and a response signal is returned. If it is 
determined that the response data is sent back, the 

35 contents of the order are stored into a memory At this 
time, the payment plan data is stored into the memory in 
correspondence to the ordered merchandise code 
(steps B1 2, B13). 

[0035] If it is determined in the step B12 that no 

40 response Is made even after a preset period of time has 
elapsed, warning display is made and a confirmation 
picture for the contoits of the order is displayed (step 
B14). In this case, the user can confirm whether the 
ordering method is correct or hot. If correction is neces- 

45 sary, the step 85 is effected again and if no correction is 
made, the step B9 is effected again. 
[0036] In the above explanation, an address of the 
specified picture is described in the management infor- 
mation when the specified picture of FIG. 2 is searched 

so for. Further, additional information accessing picture is 
superposed on the specified picture. However, this 
invention is not limited to this case, and if a caption of a 
film is superposed in the DVD, language streams of a 
plurality of countries are prepared and any one of the 

55 streanris can be selected. A concrete merchandise 
ordering mode can be set by using one of the streams 
as a stream for guidance of the merchandise, playing 
back a still picture on a desired window and referring to 
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merchandise guidance information superposed on the 
window. 

[0037] Further, in the above explanation, a method for 
searching for the specified picture and reading out mer- 
chandise guidance information while the specified pic- s 
ture is played back in a still form and the user sees the 
additional information accessing picture is explained. 
However, this invention is not limited to this case, and it 
is possible to automatically read out merchandise guid- 
ance information if the user operates the merchandise 
guidance information key at a desired timing by use of 
the remote control unit in a moving picture outputting 
state. That is, in this case, if a merchandise guidance 
information request command is issued from the renfK>te 
control system when the contents of a video image of 
the moving picture are set in the state as shown in FIG. 
3. for example, corresponding merchandise guidance 
information is searched for and displayed. In order to 
realize this, for example, control information for receiv- 
ing the merchandise guidance information request com- 
mand issued from the remote control system may be 
used together with synchronization information or timer 
information for playing back a video image when the 
video image playback timing as shown in FIG. 3 is used. 
[0038] FIG. 8 shows the outer appearance of a receiv- 
ing device of the selling store for processing data trans- 
ferred from the above system. 

[0039] The receiving device is a personal computer 
450 having a modem. If merchandise ondering data is 
received, the identification data of the orderer is con- 
firmed and the ordered merchandise, the quantity of 
merchandises and the unit price of the merchandise are 
confirmed. The personal computer 450 can read out 
data from a optical disk 451 . 

[0040] FIG. 9 is a flowchart for illustrating the opera- 
tion of the receiving device. If a telephone call for order- 
ing the merchandise from the user side is made, 
irxjoming connection is made on the receiver side to 
fetch data (steps C1 , C2). When data fetching is termi- 
nated, the ID (identification code) of the orderer, mer- 
chandise code, the quantity of merchandises, validity 
period, payment method and the like are confirmed. In 
this case, if a data error is present, the circuit is cut off 
(steps C3, C4). If no error is present, access to a stock 
control file is made and the confirmation process for the 
stock of the merchandise is effected (step C5). If the 
merchandise is kept in stock, the order-received mer- 
chandise information is stored into an order-received 
merchandise memory. Further, at this time, information 
on the orderer side is also stored. The information items 
can be used as extremely important information for the 
selling store to obtain statistical data such as salability 
of the merchandise. 

[0041] If there is no merchandise in stocK stocking 
time or the like is informed to the user as response data. 
Alternatively, communication data indicating that the 
order cannot be accepted or taken up since tiiere is no 
merchandise in stock is sent to the user (step D1). 



[0042] If the merchandise is kept in stock, information 
tiiat the order is accepted or taken up is sent to the 
orderer as response data (steps C6, C7, C8). 
[0043] If the device on the order receiving side sends 
response data indicating that there is no merchandise in 
stock or the order cannot be accepted, the orderer can 
confirm to this effect by watching the order contents 
confirming window (step B14) of FIG. 7. By watching the 
window, the orderer can select canceling of the order or 
waiting for stocking of the merchandise. When waiting 
for the stocking of the merchandise is selected, order 
information Is issued to the device of the selling store 
again together with the stocking waiting information. 
The device on the order receiving side which has 
received the stocking waiting information stores order- 
received merchandise data into a memory. 
[0044] In the above system, transmission/reception 
data is order receiving information or ordering informa- 
tion associated with the merchandise, txjt the transmis- 
sion side can input a simple memo from the keyboard, 
add the same to ordering information and send them. In 
this case, on the order receiving side, tiie memo is 
stored into another exclusive memory and the contents 
thereof can be confirmed by displaying the contents on 
the display. 

[0045] In the above explanation, a case wherein a per- 
son or a general consumer orders the merchandise to 
the selling store is shown as an example. However, this 
is not limitative and, for example, transactions between 
the personal store and the store of the selling agency 
can be effected. A system explained below is an effec- 
tive embodiment when the above-described merchan- 
dise data is applied. 

[0046] In the above explanation, a process for deter- 
mining whether the orderer pays by use of a credit card 
or electronic money or pays by the cash transfer to a 
bank or post office and a process effected when the 
payment is made by use of a credit card or electronic 
money are not explained. 

[0047] However, this system has an information 
processing function effected when the orderer pays by 
use of a credit card or electronic money or pays by the 
cash transfer to a bank or post office. The orderer can 
input information on the payment method in the steps 
87. 88 of FIG. 7. 

[0048] Further, the order receiver checks the payment 
metiiod before the step C7 of FIG. 9. 
[0049] FIG. 1 0 shows a processing routine of payment 
method information. 

[0050] First, whether or not the payment method sent 
from the orderer is a cash transfer method to a post 
office or bank is determined. If it is the cash transfer 
method, transferred destination information is added to 
response data and sent to tiie orderer (steps D1 , D2). If 
the payment method is the credit card system, a credit 
card ID and information on the ordered amount sent 
from the orderer are stored into an orderer information 
memory (step D3): Then, a comment of "We will contact 
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you by return as to whether or not the order is taken up" 
is sent back as the response data and the process is 
terminated (steps D4, D5). 

[0051] As described above, in a case where the pay- 
ment method is the credit card system, the order 
receiver will contact the orderer by return as to whether 
or not the order Is taken up. 

[0052] FIG. 11 is a flowchart for illustrating the data 
processing operation effected in the device on the order 
receiving side when response data is sent to the orderer 
side. First, data in the orderer Information memory 
which is acquired in the step D3 Is used (steps E1 , E2). 
Data of the credit card user is stored in the memory. 
[0053] The credit card tD. the telephone number of the 
orderer, ordered amount, merchandise code and the 
like are registered. In order to check the reliability of the 
owner of the credit card by use of information of the 
credit card ID. an inquiry is made to the card company. 
By this Inquiry, user's reliability data stored In the card 
company is returned by use of the telephone line. 
Based on the user's reliability data, whether the user of 
the credit card can be trusted or not is determined. 
Thus, the reliability of each orderer stored In the orderer 
information memory Is checked and data of only the 
user with high reliability is extracted (steps E3, E4). The 
order receiving information Is sent to the user with high 
reliability via the telephone line. That Is. information indi- 
cating that the order is accepted or taken up is sent 
back (step E5). In this case, whether or not an answer is 
obtained is determined when a telephone call Is made 
to the orderer who places the order. If there is no 
answer to the telephone call, that is» if the telephone call 
cannot be successfully made, order information In the 
orderer information memory Is deleted (step E7). 
[0054] If it Is determined in the step E6 that the answer 
to the telephone call Is made. Information Indicating that 
the order Is taken up Is sent back as response data 
(step E8). Next, whether or not the determination proc- 
ess for taking up or refusing the order is terminated for 
all of the user data items in the orderer information 
memory is determined (step E9) and if the process is 
terminated for all of the user data Itenns, the process is 
terminated (step E10). 

[0055] FIG. 12 shows a data processing function fur- 
ther provided in the personal computer shown in FIGS. 
1 and 8. 

[0056] A reference numeral 1 1 00 denotes a conrputer 
main body which is constituted by hardware and opera- 
tion system (OS). A reference numeral 1500 denotes a 
display section, a portion surrounded by broken lines is 
a new working device relating to this invention, and the 
portion is constituted by a recording medium and a drive 
device thereof or a logic block formed In an IC form. Of 
course, In the device, a hard disk and memory are also 
contained. 

[0057] The computer main body 1 1 00 is constituted by 
hardware and operation system (OS). A business logic 
applying section 1200 Is mounted on the computer main 



body 1 100. The business logic applying section 1200 is 
constituted by a business operation system (business 
OS) 1201 and a business rule nnatching/check section 
1202. 

5 [0058] The business operation system (business OS) 
is previously determined software such as presence 
check software, upper limit check software, lower limit 
check software and total amount check processing soft- 
ware. The above software programs are used as com- 

10 mon software programs for various processing 
operations. 

[0059] The business rule matching/check section 
1 202 serves as a determination section for determining 
which software is used when business operation system 

15 software is used based on the business logic terms of a 
business worksheet in a case where data processing is 
effected as will be descrit^ later. 
[0060] The business worksheets, business logic terms 
and rule setting data are stored in a business data file 

20 1 400. The business data file 1 400 stores various types 
of worksheets such as a register, slip and plan for rule 
setting required in business, and a slip, book and slip, 
ordering slip and settling slip used In distribution busi- 
ness. The worksheet Includes at least one business 

25 logic term representing the meaning on business in the 
minimum unit. 

[0061] A data Input position is present in correspond- 
ence to the business logic term. When the worksheet of 
a plan or rule setting is used In designing a program and 
30 data is input to the data input position, the input data is 
used as rule setting data. 

[0062] After the rule setting data is input and when 
data Is input to a data input position of a worksheet such 
as a rule confirmation or estimate while the computer is 
35 used for business purposes, the input data is used as 
application data. 

[0063] Newly input data is stored Into an input data file 
1 401 . The input data file 1 401 is set to con'espond to the 
business data file 1400 and has a data area corre- 

40 spending to the business logic term of the worksheet. 
Data in the data area can be rewritten and the data area 
can be constituted by a rewritable memory or disk. 
[0064] A reference numeral 1500 derK>tes a display 
which displays a worksheet when a program is created 

45 or when a program is used after the program is created. 
The display 1500 Is used so as to permit the user to 
confirm the data input or the result of program process- 
ing. In creating and using a program, an overall man- 
agement section 1600 is operated in response to an 

50 input operation from the operation unit to access periph- 
eral block data or start the peripheral block and thus 
control data input/output timings. 
[0065] In response to the operation input via the over- 
all management section 1600, a display controller 1300 

55 determines a specified one of the worksheets to be dis- 
played and reads out the data from the business data 
file 1400- At this time, data accompanying to the read- 
out worksheet is also read out. The readout data and 
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worksheet are transmitted via the overall management 
section 1600 and displayed on the display 1500. As 
accompanying data, data in the input data file 1401. is 
also contained. 

[0066] As shown in FIGS. 13 A, 13B, for example, the 5 
business logic terms are described in the worksheet 
and data is described in blank portions (data input posi- 
tions) corresponding to the business terms. In this 
example, a worksheet for setting a credit amount for a 
client is used. The title "Description of Credit Amount for 
Client" is set as the title. In order to read out the work- 
sheet of this title, an operation called the starting opera- 
tion of program creation (or business rule setting) is 
performed by use of an operation unit 1501 and. for 
example, if a menu Is requested, a titie menu corre- 
sponding to the request appears. 
[0067] The user refers to tiie titie menu and clicks the 
title "Desaiption of Credit Amount for Client". Therefore, 
the worksheet is displayed on the display. 
[0068] The overall management section 1600 acti- 
vates the system and responds to an input from the 
operation unit 1501 . 

[0069] Since the data processing contents corre- 
sponding to the item "Description of Credit Amount for 
Client" are previously determined, tiie txjsiness logic 
applying section 1200 has data indicating the correla- 
tion between software for performing the data process- 
ing and the worksheet 

[0070] In the display state shown in FIG. 13A, the cli- 
ent number, company name and the like are input. The 
worksheet also has columns of the date of start of appli- 
cation, the date of end of application, the credit amount, 
and the stop of application and data items necessary for 
the columns are desaibed in the respective columns. In 
this example, the date of start of application of 97/06/06 
and the credit anriount of 200.000,000 are described 
and no data is described in the columns of the date of 
end of application and the stop of application. In this 
system, whether or not data is described in each col- 
umn and whether or not the data processing is effected 
according to tiie meaning of tiie business logic in each 
column are automatically determined. For example, 
since data is described in tiie column of the date of start 
of application, the check process for the date of start of 
application is effected. Further, since no data is 
described in tiie column of the stop of application, the 
determination process for determining whether the stop 
of application is effected or not is not performed. If data 
of stop is described in the column of the stop of applica- 
tion, the data process for each item is not performed 
from tiie beginning. 

[0071 ] A worksheet for creating a sales merchandise 
list of a client is also stored in tiie business logic apply- 
ing section 1200. Therefore, various types of data items 
of tiie client (the data items are referred to as business 
rule setting data items) can be created. 
[0072] When the operation of describing necessary 
rule setting data items in the necessary worksheet is 



completed, the end of window display is clicked. Then, 
each worksheet is stored into the business data file 
1400. Since the necessary data processing in a busi- 
ness operation is previously determined according to 
the type (contents) of rule setting data, a program to be 
applied to each data can be determined by inputting 
data as desaibed above. 

[0073] For example, when application data is input to 
check a client for the credit amount in the actual use of 
the conputer on business, it is necessary to determine 
whether the application data is adequate or not. There- 
fore, the upper limit check process for comparing the 
previously input credit amount (business setting data) 
with the application data to determine whether or not 
the application data exceeds the value of the business 
rule setting data is performed. 

[0074] In order to input the application data, an input 
worksheet (not shown) is present. 
[0075] That is. in this apparatus, business application 
software is perfectiy separated into business application 
software and program logic (computer logic) according 
to a predetermined reference, and the construction of 
the apparatus is considered. The predetermined refer- 
ence can be determined by dealing with business work- 
sheets (business documents) and items expressed in 
tiie worksheets as objects, and slips materials in the 
form of a computer window or computer book and slip 
are separately extracted. 

[0076] Further, the business data items are classified 
into items of a kxjsiness transaction know-how data 
group (meaningful minimum unit elements for determin- 
ing tiie contents of a business contract), a basic busi- 
ness operation data group (meaningful minimum unit 
elements such as company rules for pursuing tfie con- 
tract), and an account data group (meaningful minimum 
unit elements such as accounting processing rules 
based on the commercial law. tax law. commercial 
transaction law) and the data groups are set to corre- 
spond to application software programs to process tiie 
data groups. That is. the data groups are set to corre- 
. spond to the application software programs such as the 
upper limit check program, lower limit check program, 
presence check program, total amount processing pro- 
gram and the like. 

[0077] By separating and arranging the data as 
described above, only tiie mechanism of the application 
software for processing the above items is left as tiie 
program logic and is used as the business OS. If the 
contents of the business items are known, the remain- 
ing portions of the business items are simple data. The 
data items are business data. 

[0078] As a result, tiie software (business OS) stored 
in the business logic applying section 1200 is a software 
group for performing the upper limit check process, 
lower limit check process, presence check process and 
total amount processing by use of the application data 
(data input when the apparatus of this invention is used 
in the actual business transaction) and business rule 
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setting data (previously stored as a data base) corre- 
sponding to the application data. 
[0079] Referring back to FIGS. 1 3A-1 SB, the explana- 
tion Is nnade. A data base using the worksheet as shown 
in FIG. 13A is created, tn the above example, a case 
wherein the credit amount is set for a given client com- 
pany is explained. In addition, a client company list data 
base, data base of sales merchandises for clients, data 
of unit prices and quantity information of the sales mer- 
chandises can also be created. 
[0080] FIG. 13B shows an example of an application 
window Indicating that an order from a client ABCD Co. 
Is received. In this case, an application worksheet is 
read out as the worksheet and. as shown in FIGS. 13A, 
13B, accessed information is Input to a necessary posi- 
tion. That Is. the client code, client name, merchandise 
code, unit price, quantity, amount of order received and 
the like are input. After the above data Items are input, 
the operation start is Instructed. The apparatus Is 
switched to the application mode by the operation unit 
1501 and the user requests the menu of the application 
window for the worksheet of the application window. As 
a result, the display controller 1300 displays the title of 
the application worksheet When a desired title, that Is, 
"receipt of order" in this case is present, the user dicks 
the title. 

[0081] By this operation, the application window of 
FIG. 13B can be obtained on the display 1500. After 
this, the user inputs data. In this case. If the start of 
inquiry is operated, the operation for determining 
whether or not the amount of order received exceeds 
the credit amount (upper limit check process) is per- 
formed. At this time, the software is executed as follows. 
The business logic applying section 1200 recognizes 
the Item of the amount of order received to automati- 
cally select the software for the upper limit check proc- 
ess and then executes the software. Data obtained as 
the result of the above process is displayed as "within 
the credit amount" or "over the credit amount" on the 
display 1500 via the display controller 1300 and overall 
management section 1 600. 

[0082] In the above apparatus, each block surrounded 
by the broken lines may be constructed by a logic cir- 
cuit, but function data Items of the overall management 
section 1600. term converting section 1802, display 
controller 1300. business logic applying section 1200, 
and business data file 1400 are previously recorded on 
the optical disk and the function data items are read out 
by the microcomputer to create the function blocks. An 
order data storing section 1801 and input data file 1401 
may be securely acquired in part of the optical disk if the 
optical disk is of programmable type or may be aeated 
by a memory or hard disk previously provided in the 
microcomputer. 

[0083] FIG. 14 shows a correlation table between the 
worksheets, business logic terms described in the work- 
sheets, worksheet group data in which the business 
logic terms are present, and application software. By 



causing the business data file 1400 or business logic 
applying section 1200 to have the correlation table, it 
becomes possible to recognize the worksheet which is 
now accessed on the display 1500. recognize the con-e- 
5 spending business logic term when data is input, and 
determine the application software. Data obtained as 
the result of application of the software Is fed back as a 
window on the display again. 

[0084] The table of FIG. 14 may be described in the 
10 block of the business logic applying section 1200 or 
business data file 1400. 

[0085] As described above, If the order Is received, the 
credit amount is checked and the check process can be 
effected after the step C6 of the flowchart explained with 

15 reference to FIG. 9. The process becomes effective 
when a large amount of orders of merchandises are 
given from the client. If the credit amount is exceeded, a 
response Indicating to this effect is sent to the orderer to 
make the transaction safe. 

20 [0086] In the system, a function of checking the data 
form so as to permit fetched data as explained with ref- 
erence to FIG. 9 to used In the apparatus shown in FIG. 
12 is provided. That is, ordered merchandise data 
received in the receiving section 1800 is temporarily 

25 Stored In the merchandise data storing section 1 801 via 
the overall management section 1600 (refer to the step 
C7 in FIG. 9). Next, a window as shown in FIG. 13B is 
read out from the business data file 1400 of the system. 
Then, the user determines whether the describing man- 

30 ners of the client No., merchandise code, unit price and 
quantity are adequate or not and if they are adequate, 
the user drags to desaibe data of the items into respec- 
tive items of corresponding business logic terms. If any 
one of them Is inadequate, the user rewrites it into an 

35 adequate form and drags. 

[0087] FIG. 15 shows a state in which a business data 
file to be applied is read out to the display 1500 and 
received ordered merchandise Information is displayed 
in a superposed form. 

40 [0088] The user (receiver of an order) determines 
whether the identification code of the orderer corre- 
sponds to the client No. or not, and if it does not corre- 
spond to the client No., the user describes data 
obtained by correcting the identification code into a 

45 blank portion of a preset item. Further, whether the mer- 
chandise code Is set in an adequate format or not is 
determined, and if it is inadequate, it is rewritten into an 
adequate format and described into a blank portion of a 
preset item of the business worksheet. 

50 [0089] Thus, the user of the above apparatus can use 
merchandise information of the recording medium as 
transaction data. 

[0090] In the above explanation, information for trans- 
action is transmitted via the telephone line and 
55 response information is received, but the circuit is not 
limited to this example, and It is of course possible to 
use the private line or the circuit of internet or ISDN. 
[0091] Further, ordering and receipt of an order of the 
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merchandise have been explained, but it is of course 
possible to contain guidance information of a sight-see- 
ing resort appearing on the window or information of a 
method for reservation of a hotel or inn as the associ- 
ated information. 5 
[0092] As described above, according to this inven- 
tion, a picture information applying method and appara- 
tus for making it possible to use a recording medium for 
another application, and a recording medium used 
therefor can be provided. w 
[0093] The user who purchases a recording medium 
can not only see the film but also orders a wear or shoes 
which a person appearing on the film wears to the sell- 
ing agency. Further, the selling store or the maker of the 
merchandise can give an advertisement and propa- is 
ganda via the recording medium (optical disk) and get a 
chance leading to the actual merchandise sales. Fur- 
ther, by collecting sales data, reference materials used 
as salability information and used for determining the 
future sales plan can be obtained. In addition, a disk 20 
maker or film maker can collect furxjs for making the film 
by using a merchandise maker or selling agency as a 
sponsor. 

[0094] This invention provides a picture information 
applying method and apparatus for causing a recording 25 
medium to be used for another application and a record- 
ing medium used therefor. For this purpose, picture data 
(102) is recorded on a recording medium (100) and 
associated information (P1 1) containing at least a to-be- 
connected destination and merchandise guidance for a 30 
merchandise appearing in a video image (P1) displayed 
based on the picture data is recorded, and when a 
recording signal of the recording medium is played 
back, the corresponding merchandise guidance can be 
observed based on the associated information and it is 35 
made possible to make contact with the destination 
associated with the corresponding merchandise based 
on the associated information. 

Claims 40 

1. A picture Information applying method character- 
ized by comprising the steps of: 
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2. A recording medium (100) characterized by com- 
prising: 

an area in which picture data is recorded; and 
an area in which associated information (103) 
containing at least destination information for a 
merchandise appearing In a picture displayed 
based on the picture data is recorded. 

3. The recording medium according to daim 2, char- 
acterized in that the picture data is compression 
data obtained by compressing a moving picture, the 
associated information is displayed as a video 
image on part of a field picture (or a frame picture) 
when the compressed data is decoded, arKi the 
associated information includes first associated 
information (P11. P12) indicating that a merchan- 
dise displayed by the field picture (or frame picture) 
is an object to be guided and second associated 
information (p41, P42) searched for based on oper- 
ation information input along the guide line shown 
by the first associated information and containing 
detail information of the merchandise. 

4. The recording medium according to claim 3, char- 
acterized In that the first associated information is a 
signal previously superposed on the field picture (or 
frame picture) as part of the video image. 

5. The recording medium according to claim 3, char- 
acterized in that the first associated information is 
data ananged and recorded separately from com- 
pression data obtained by compressing the moving 
picture and is a signal played back in synchronism 
with a corresponding field picture (or frame picture). 

6. The recording medium according to claim 3, char- 
acterized In that the first or second associated infor- 
mation contains information of a telephone number 
of a selling agency of the merchandise. 

7. The recording medium according to claim 3. char- 
acterized in that the second associated information 
contains information of a validity period in which the 
merchandise can be ordered. 

8. The recording medium according to claim 3, char- 
acterized by further comprising an area in which 
software for transmitting merchandise information 
associated with a merchandise ordered based on 
the second associated information via a transmis- 
sion line is recorded. 

9. A picture information applying apparatus for playing 
tDack a recording medium on which recording pic- 
ture data (102) is recorded and associated informa- 
tion (1 03) containing at least information of a to-be- 
connected destination for a merchandise appearing 



recording picture data (102) on a recording 45 
medium (100): and 

recording associated Informaton containing at 
least a to-be-connected destination and mer- 
chandise guidance for a merchandise appear- . 
ing in a video image displayed t^sed on the so 
picture data (102); 

wherein the corresponding merchandise guid- 
ance can be observed based on the associated 
information on a display device (300. 400) to 
make it possible to make contact with the des- ss 
ti nation when a recording signal of the record- 
ing medium Is played back. 
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in a video image displayed based on the picture 
data, characterized by comprising: 

means (A1 , A2) for reading out the picture data 
of the recording medium and acquiring a first s 
display signal for displaying a decoded video 
image thereof; and 

associated information processing means (A4, 
A5, A6, A7) for acquiring a secorxj display sig- 
nal for displaying the destination information io 
based on an operation input information and 
the associated information. 

1 0. The picture information applying apparatus accord- 
ing to claim 9, characterized in that said associated 75 
information processing means displays information 
containing a merchandise code, price, validity 
period, presence or absence of an order necessary 

for ordering the merchandise together with the des- 
tination information. 20 

1 1 . The picture information applying apparatus accord- 
ing to claim 9, characterized in that said associated 
information processing means has a function of 
transmitting data associated with an ordered mer- 25 
chandise based on the destination information via a 
transmission line. 
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